Vibration control method and system for computer device

ABSTRACT

Techniques for controlling vibrations of a computing device is provided in the present disclosure. The techniques comprise obtaining a target audio file of a multimedia file; dividing the target audio file into a plurality of audio segments; determining a target audio segment among the plurality of audio segments based on detecting at least one feature associated with each of the plurality of audio segments; determining a target time period in a total time period of playing the multimedia file, the target time period corresponding to a playback of the target audio segment in the multimedia file; monitoring a current time point of playing the multimedia file; and controlling a vibration element in the computing device to perform a vibration operation when the current time point of playing the multimedia file is within the target time period.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority of Chinese Patent ApplicationNo. 202010486027.1, file on Jun. 1, 2020, entitled “Vibration controlmethod and system for computer device”. Entire content of the Chinesepatent application is incorporated in the present application byreference.

BACKGROUND

There is more and more interaction between users and computer devicessuch as tablets and mobile phones, for example, watching movies, videos,or games. With the popularization of concepts such as augmented realityand virtual reality, people are increasingly demanding computer devicesfor entertainment. However, when current computer devices play videocontent such as movies and games, output form provided is single, theinteractive way is few, resulting in a poor user experience, which hasobviously failed to meet people's current entertainment demand.

SUMMARY

The purpose of embodiments of the present application is to provide avibration control method and system for a computer device, computerdevice, and computer readable storage medium to solve the followingproblems: in the prior art, when the computer device plays multimediafiles such as movies and games, an output form provided is single, theinteractive way is few, and user's experience is poor.

On one aspect of the embodiments of the present application a vibrationcontrol method for a computer device is provided, and the methodincludes obtaining a target audio file of a multimedia file; dividingthe target audio file into a plurality of audio segments; determining atarget audio segment among the plurality of audio segments based ondetecting at least one feature associated with each of the plurality ofaudio segments; determining a target time period in a total time periodof playing the multimedia file, the target time period corresponding toa playback of the target audio segment in the multimedia file;monitoring a current time point of playing the multimedia file; andcontrolling a vibration element in the computing device to perform avibration operation when the current time point of playing themultimedia file is within the target time period.

On another aspect of the embodiments of the present application, acomputer device is provided, which includes a memory, a processor, andcomputer programs that stored in the memory and operable on theprocessor, wherein the computer programs are executed by the processorto implement steps of the vibration control method for computer devicedescribed above.

On another aspect of the embodiments of the present application, acomputer readable storage medium, which stores computer programs thatupon execution by at least one processor causes the at least oneprocessor to implement steps of the vibration control method forcomputer device described above.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 schematically shows an application environment diagram of avibration control method for a computer device according to anembodiment of the present application.

FIG. 2 schematically shows another application environment diagram of avibration control method for computer device according to an embodimentof the present application.

FIG. 3 schematically shows a flowchart of a vibration control method forcomputer device according to a first embodiment of the presentapplication.

FIG. 4 schematically shows a sub-step of step S302 in FIG. 3 .

FIG. 5 schematically shows a sub-step of step S402 in FIG. 4 .

FIG. 6 schematically shows a sub-step of step S304 in FIG. 3 .

FIG. 7 schematically shows another sub-step of step S304 in FIG. 3 .

FIG. 8 schematically shows another sub-step of step S304 in FIG. 3 .

FIG. 9 schematically shows another flowchart of a vibration controlmethod for a computer device according to a first embodiment of thepresent application.

FIG. 10 schematically shows a block diagram of a vibration controlsystem for a computer device according to a second embodiment of thepresent application.

FIG. 11 schematically shows a schematic diagram of a hardwarearchitecture of a computer device suitable for implementing a vibrationcontrol method for a computer device according to a third embodiment ofthe present application.

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

In order to make the purpose, technical solutions, and advantages of thepresent application clearer, the following further describes the presentapplication in detail with reference to the accompanying drawings andembodiments. It should be understood that the specific embodimentsdescribed here are only used to explain the present application, and notused to limit the present application. Based on the embodiments in thepresent application, all other embodiments obtained by those of ordinaryskills in the art without creative work are falling within theprotection scope of the present application.

It should be noted that the descriptions related to “first”, “second”and so on in the embodiments of the present application are only fordescriptive purposes, and cannot be understood as indicating or implyingtheir relative importance or implicitly specifying the indicatedtechnical features quantity. Therefore, the features defined with“first” and “second” may explicitly or implicitly include at least oneof the features. In addition, the technical solutions between thevarious embodiments can be combined with each other, but they must bebased on what can be achieved by those of ordinary skill in the art.When the combination of technical solutions is contradictory or cannotbe achieved, it should be considered that such a combination oftechnical solutions does not exist, and is not within the scope ofprotection required by the present application.

The vibration control method and system for a computer device, computerdevice, and computer readable storage medium provided in the embodimentsof the present application enable the computer device to output audiocontent, video content, and vibration in the process of playing amultimedia file. That is, in the process of playing the multimedia file,the computer device increases the tactile content output, effectivelyincreases the output form and interactive ways, and improves theinteraction with users, so that the user has a more realisticexperience.

The computer device 2 may be configured to provide multimedia playingservices. The multimedia play services may be configured to receivecontent via various transmission technologies and play the receivedcontents. The content may include content streams (for example, videostreams, audio streams), content files (for example, video files, audiofiles), and/or other data.

The computer device 2 may be configured to access the contents andservices of a provider network 4. The computer device 2 may be a mobiledevice such as a smart phone, a tablet device, an augmentedreality/virtual reality device, a smart watch with a built-in vibrationelement (such as a vibration motor), and the like.

The computer device 2 may be associated with one or more users. A singleuser can use the computer device 2 to access the provider network 4. Thecomputer device 2 can travel to various locations and use differentnetworks to access the provider network 4.

The computer device 2 may include an application 2A and otherapplications. The application 2A outputs (such as displays, renders, andpresents) the contents to the user. The application 2A may be amultimedia player (such as a Bilibili client), a browser client, and soon. As an example, as shown in FIG. 1 and FIG. 2 , FIG. 1 shows a videoscreen when the application 2A plays a music video, and FIG. 2 shows thevideo screen when the application 2A plays a game video.

In video scenes, as shown in FIG. 1 or FIG. 2 , the computer device 2also outputs tactile information in a vibration manner while outputtingvisual information and auditory information. That is, the presentapplication can enhance the interaction with users by increasing thevibration, so as to achieve a full range of visual, auditory and tactilecontent output, making the user feel more real. It should be noted thatthe video scenes shown in FIG. 1 and FIG. 2 are exemplary and are notused to limit the protection scope of the present application.

A First Embodiment

FIG. 2 schematically shows a flowchart of a vibration control method ofa computer device according to a first embodiment of the presentapplication. It can be understood that the flowchart in the methodembodiment is not used to limit the order of execution of the steps. Thefollowing exemplarily describes the computer device 2 as the executionsubject.

As shown in FIG. 3 , the vibration control method of the computer device2 may include steps S300 to S310, wherein:

Step S300, playing a multimedia file.

The multimedia file refers to an overall file formed by combining audiocontent, image content, text content, and animation content, and thelike. Of course, in other embodiments, the multimedia file may also bean audio-only file.

The multimedia file may be a local file in the computer device 2 or anonline file obtained through the Internet.

The multimedia file may include various types of content, for example,music-type audio and video content as shown in FIG. 1 , game-type audioand video content as shown in FIG. 2 , movie-type audio and videocontent, or other types of content.

Step S302, obtaining a target audio file of the multimedia file, anddividing the target audio file into multiple audio segments.

In order to prevent a noise signal from interfering with subsequentdetection operations to improve detection accuracy, the target audiofile should be an audio file without noise signal interference or withnoise signal interference within a controlled preset range, or an audiofile after removing noise signal.

The computer device 2 can separate an initial audio file from themultimedia file, and perform noise interference detection on the initialaudio file. When the initial audio file is the audio file without noisesignal interference or with noise signal interference within thecontrolled preset range, the computer device 2 uses the initial audiofile as the target audio file. When the initial audio file is the audiofile with excessive noise signal interference, the computer device 2needs to preprocess the initial audio file to remove noise signal in theinitial audio file.

Which signal in the initial audio file can be considered as the noisesignal is determined according to content of the multimedia file. Asshown in FIG. 1 , when the content of the multimedia file is music-typeaudio and video content, a voice signal in the initial audio file may beconsidered as the noise signal causing interference. As shown in FIG. 4, step S302 may include steps S400 to S404, wherein: S400, extractingthe initial audio file of the multimedia file; S402, determining thenoise signal and a non-noise signal in the initial audio file accordingto the content of the multimedia file; and S404, separating the noisesignal and the non-noise signal in the initial audio file to obtain thetarget audio file corresponding to the non-noise signal. In someembodiments, the computer device 2 can separate the noise signal and thenon-noise signal in the initial audio file through a trained deep neuralnetwork model, a hidden Markov model and so on. In other embodiments,the computer device 2 may also implement the separation operation instep S402 in other ways, such as time domain analysis or frequencydomain analysis.

Exemplarily, in step S402, the computer device 2 may obtain or determinethe content of the multimedia file according to the classification,introduction, and comment keywords of the multimedia file. Herein, thecontent of the multimedia file includes but is not limited to a musictype, a commentary type, and so on. The content of the multimedia fileis different, and the determined noise signal and the non-noise signalin the initial audio file are also different. For example, when thecontent of the multimedia file is music-like audio and video content,when the content of the multimedia file is music-type audio and videocontent, a voice signal in the initial audio file is determined to bethe noise signal and a non-voice signal in the initial audio file isdetermined to be the non-noise signal; when the content in themultimedia file is the commentary type, the non-voice signal in theinitial audio file is determined to be the noise signal and the voicesignal in the initial audio file is determined to be the non-noisesignal.

As an example, in some situations, the voice signal in the initial audiofile may be regarded as the noise signal causing interference. As shownin FIG. 5 , step S402 may include steps S500 to S502, wherein: stepS500, determining whether the content of the multimedia file ismusic-type audio and video content; step S502, when the content of themultimedia file is music-type audio and video content, determining thevoice signal in the initial audio file to be the noise signal and thenon-voice signal in the initial audio file to be the non-noise signal.The advantage is that the human voice interference in music-type audioand video content can be eliminated, so as to improve the accuracy ofsubsequent drum detection.

Step S304, detecting each of the audio segments and determining a targetaudio segment from the multiple audio segments according to a detectionresult.

Exemplarily, each of the audio segments may be 10 milliseconds.

Exemplarily, the target audio segment should have special features todistinguish from other audio segments in the multiple audio segments.The target audio segment among the plurality of audio segments isdetermined based on detecting at least one feature associated with eachof the plurality of audio segments. For example, compared to other audiosegments in the multiple audio segments, the target audio segment canmore arouse user's experience.

In the exemplary embodiment, in order to quickly and accurately obtainthe target audio segment from the multiple audio segments, as shown inFIG. 6 , step S304 may include steps S600 to S602, wherein: S600,identifying whether each of the audio segments is an audio segmentcomprising an abrupt change; S602, when one of the multiple audiosegments is the audio segment comprising the abrupt change, thendetermining the audio segment as the target audio segment. In someembodiments, the computer device 2 can recognize whether each of theaudio segments is the audio segment comprising an abrupt change throughthe trained deep neural network model, hidden Markov model, and so on.In other embodiments, the computer device 2 may also implement theidentification operation in step S500 S600 in other ways, such as timedomain analysis or frequency domain analysis.

Wherein, the model recognition is to identify the audio segmentcomprising an abrupt change through audio features of each of the audiosegments (such as Mel cepstrum coefficient (MFCC), fundamentalfrequency, and so on). The time domain analysis is to find the audiosegment comprising an abrupt change by calculating energy accumulationof a waveform file. The frequency domain analysis is to find the audiosegment comprising an abrupt change by calculating spectral energychange.

The audio segment comprising an abrupt change has at least one of thefollowing features:

First, an energy change range exceeding a first threshold. The energychange range may refer to the energy change range inside the audiosegment, or the energy change range between the audio segment and anadjacent previous audio segment. In some embodiments, the energy changerange may be understood as an energy increase range.

Second, a pitch change range exceeding a second threshold. The pitchchange range may refer to the pitch change range inside the audiosegment, or the pitch change range between the audio segment and theadjacent previous audio segment. In some embodiments, the pitch changerange can be understood as a pitch increase range.

Third, a timbre change range exceeding a third threshold. The timbrechange range may refer to the timbre change range inside the audiosegment, or the timbre change range between the audio segment and theadjacent previous audio segment. In some embodiments, the timbre changerange can be understood as a timbre increase range.

The above steps S600 to S602 provide a first obtaining way of the targetaudio segment. The following provides a second obtaining way.

As mentioned above, the multimedia file may include various types ofcontent, such as music-type audio and video content, game-type audio andvideo content, movie-type audio and video content, or other types ofcontent. Different types of content have different perceptions of theuser. For example, for the music-type audio and video content, the userfocuses on rhythm; for the game-type audio and video content, the userfocuses on threatening sounds such as gunshots.

In the exemplary embodiment, in order to quickly and accurately obtainthe target audio segment that meets the user's focus (or stimulationpoint) from the multiple audio segments, as shown in FIG. 7 , step S304may include steps S700 to S702, wherein: S700, determining an audio typeof the target audio file; S702, performing a detection operation on themultiple audio segments and determining the target audio segment basedon a predetermined rule corresponding to the audio type. For example,when the audio type is a music audio type, and the target audio segmentis an audio segment with a musical drum; when the audio type is a gameaudio type, and the target audio segment is an audio segment with agunshot sound point.

The following provides a third obtaining way.

In the exemplary embodiment, in order to quickly and accurately obtainthe target audio segment from the multiple audio segments, as shown inFIG. 8 , step S304 may include steps S800 to S804, wherein: S800,obtaining a feature parameter of each of the audio segments; S802,inputting the feature parameter of each of the audio segments to atrained deep neural network model; and S804, determining the targetaudio segment from the multiple audio segments according to an outputresult of the deep neural network model. In some embodiments, theinitial deep neural network model can be trained through a large amountof music-type audio content to obtain the deep neural network model forfinding musical drums. In other embodiments, the initial deep neuralnetwork model can be trained through a large amount of game-type audiocontent to obtain the deep neural network model for finding gunshots orother special sounds. In other embodiments, the initial deep neuralnetwork model may be trained through a large amount of various types ofaudio contents to obtain the deep neural network model for findingvarious mutational points.

Step S306, determining a target time period in a total time period ofplaying the multimedia file, the target time period corresponding to aplayback of the target audio segment in the multimedia file.

For example, the total playing time of the audio file is 30 seconds, theaudio file is divided into 3000 audio segments, and the time length ofeach audio segment is 10 milliseconds. Therefore, the first audiosegment is the 0th to 9th milliseconds, the second audio segment is 10thto 19th milliseconds, the third audio segment is 20th to 29thmilliseconds, . . . , the 300th audio segment is 29990th to 29999thmilliseconds. For example, when the third audio segment in the audiofile is the target audio segment, the 20th to 29th milliseconds can bedetermined to be the target time period based on the target audiosegment.

Step S308, monitoring a current playing time point of the multimediafile.

The current playing time point is a playing time point corresponding tothe multimedia content (video frame) currently being played. The playingtime point is a relative position point in the total playing timeperiod. The current playing time point corresponds to a current positionpoint in the playing progress bar displayed by the application 2A whenthe multimedia content is played.

Step S310, controlling a vibration element in the computer device toperform a first type of vibration operation when the current playingtime point enters the target time period.

The first type of vibration operation may be a pulse vibrationoperation.

As an example, the content of the multimedia file is game-type audio andvideo content, and the target audio segment is the audio segment withgunshot sound points. The computer device 2 simultaneously outputs agunshot picture and a gunshot sound and performs the pulse vibrationoperation in the target audio segment when playing the target audiosegment of the multimedia file. That is, when the computer device 2 alsooutputs tactile information in a vibration manner when outputting visualinformation and auditory information, which realizes a full range ofcontent output in visual, auditory, and tactile, effectively improvinguser's experience.

In the exemplary embodiment, the computer device 2 may also perform asecond type of vibration operation to further enhance the interactionwith the user and enhance the user's experience. As shown in FIG. 9 ,the method may further include steps S900 to S902, wherein: S900,detecting an audio power of each of the audio segments; S902,controlling the vibration element in the computer device to perform thesecond type of vibration operation according to the audio power of eachof the audio segments. The first type of vibration operation may be acontinuous vibration operation. The amplitude of the continuousvibration operation varies with the audio power of each of the audiosegments. In the embodiment, in the process of playing the multimediafile, the computer device 2 controls the vibration element to performthe vibration operation through a pulse vibration signal and acontinuous vibration signal, thereby enhancing the vibration experience.

The vibration control method for the computer device provided in theembodiments of the present application enables the computer device toautomatically detect each audio segment in the multimedia file in theprocess of playing the multimedia file, and determine whether each audiosegment meets the conditions for performing the first type of vibrationoperation according to the audio features of each audio segment (such asenergy change, pitch change, and so on). The audio segment that meetsthe first type of vibration condition is determined as the target audiosegment, and the first type of vibration operation is performed when themultimedia file is played to the target time period corresponding to thetarget audio segment. In other words, the embodiments of the presentapplication can still output visual information and auditory informationwhile the multimedia file itself does not provide any vibrationinformation, and can also output tactile information in a specific timeperiod (such as the target time period) in a vibration manner, improvinguser's experience and having a wide range of applications. Theembodiment of the present application realizes the full range of contentoutput in visual, auditory and tactile by increasing vibration, whicheffectively increases the output form and interaction mode and enhancesthe interaction with the user, so that the user has a more realisticexperience.

A Second Embodiment

FIG. 10 schematically shows a block diagram of a vibration controlsystem for a computer device according to a second embodiment of thepresent application, the vibration control system for computer devicemay be divided into one or more program modules, and the one or moreprogram modules are stored in a storage medium and executed by one ormore processors to complete the embodiment of the present application.The program modules referred to in the embodiment of the presentapplication refer to a series of computer program instruction segmentscapable of completing specific functions. The following description willspecifically introduce the function of each program module in theembodiment.

As shown in FIG. 10 , the vibration control system for computer device1000 may include a playing module 1010, an obtaining module 1020, adetecting module 1030, a determining module 1040, a monitoring module1050, and a controlling module 1060, wherein:

The playing module 1010, playing a multimedia file.

The obtaining module 1020, obtaining a target audio file of themultimedia file, and dividing the target audio file into multiple audiosegments.

The detecting module 1030, detecting each of the audio segments toobtain a target audio segment from the multiple audio segments accordingto a detection result.

The determining module 1040, determining a target time period in a totalplaying time period of the multimedia file according to the target audiosegment.

The monitoring module 1050, monitoring a current playing time point ofthe multimedia file.

The controlling module 1060, controlling a vibration element in thecomputer device to perform a first type of vibration operation when thecurrent playing time point enters the target time period.

In an exemplary embodiment, the obtaining module 1020, is further for:extracting an initial audio file of the multimedia file; determining anoise signal and a non-noise signal in the initial audio file accordingto content of the multimedia file; and separating the noise signal andthe non-noise signal in the initial audio file to obtain the targetaudio file corresponding to the non-noise signal.

In the exemplary embodiment, the obtaining module 1020, is further for:determining whether the content of the multimedia file is music-typeaudio and video content; and when the content of the multimedia file ismusic-type audio and video content, determining a voice signal in theinitial audio file to be the noise signal and a non-voice signal in theinitial audio file to be the non-noise signal.

In the exemplary embodiment, the obtaining module 1020, is further for:extracting the initial audio file of the multimedia file; and separatinga voice signal and a non-voice signal in the initial audio file toobtain the target audio file corresponding to the non-voice signal.

In the exemplary embodiment, the detecting module 1030, is further for:identifying whether each of the audio segments is an audio segmentcomprising an abrupt change; and when one of the multiple audio segmentsis the audio segment comprising an abrupt change, then determining theaudio segment as the target audio segment.

In the exemplary embodiment, the mutational audio segment includes atleast one of following features: an energy change range exceeding afirst threshold; a pitch change range exceeding a second threshold; or atimbre change range exceeding a third threshold.

In the exemplary embodiment, the detecting module 1030, is further for:determining an audio type of the target audio file; and performing adetection operation on the multiple audio segments to obtain the targetaudio segment associated with the audio type.

In the exemplary embodiment, the audio type is a music audio type, andthe target audio segment is an audio segment with a musical drum.

In the exemplary embodiment, the audio type is a game audio type, andthe target audio segment is an audio segment with a gunshot sound point.

In the exemplary embodiment, the detecting module 1030, is further for:obtaining a feature parameter of each of the audio segments; inputtingthe feature parameter of each of the audio segments to a trained deepneural network model; and determining the target audio segment from themultiple audio segments according to an output result of the deep neuralnetwork model.

In the exemplary embodiment, the controlling module 1060, is furtherfor: detecting an audio power of each of the audio segments; andcontrolling the vibration element in the computer device to perform asecond type of vibration operation according to the audio power of eachof the audio segments.

A Third Embodiment

FIG. 11 schematically shows a schematic diagram of a hardwarearchitecture of a computer device suitable for implementing a vibrationcontrol method for the computer device according to a third embodimentof the present application. In the embodiment, the computer device 2 isa device capable of automatically performing numerical calculationsand/or information processing according to predefined or storedinstructions, such as can be a smart phone, a tablet, a laptop, adesktop computer, a rack server, a blade server, a tower server or arack server (including independent servers, or server clusters composedof multiple servers), etc. As shown in FIG. 11 , the computer device 2includes, but is not limited to, a memory 1110, a processor 1120, anetwork interface 1130, and a vibration element 1140 that can becommunicated with each other through a system bus. Wherein:

The memory 1110 includes at least one type of computer readable storagemedium. The readable storage medium includes flash memory, hard disk,multimedia card, card type memory (such as SD or DX memory, etc.),random access memory (RAM), static random access memory (SRAM),read-only memory (ROM), electrically erasable programmable read-onlymemory (EEPROM), programmable read-only memory (PROM), magnetic memory,magnetic disk, optical dis and so on. In some embodiments, the memory1110 may be an internal storage module of the computer device 2 such asa hard disk or memory of the computer device 2. In other embodiments,the memory 1110 may also be an external storage device of the computerdevice 2, such as a plugged hard disk provided in the computer device 2,a smart media card (SMC), secure digital (SD) card, a flash memory card,and so on. Of course, the memory 1110 may also include both an internalstorage module and an external storage device of the computer device 2.In the embodiment, the memory 1110 is generally used to store anoperating system and various types of application software installed inthe computer device 2 such as program codes of the vibration controlmethod for computer device and the like. In addition, the memory 1110may also be used to temporarily store various types of data that havebeen or will be outputted.

The processor 1120, in some embodiments, may be a central processingunit (CPU), a controller, a microprocessor, or other data processingchip. The processor 1120 is generally used to control the overalloperation of the computer device 2 such as performing control andprocessing related to data interaction or communication with thecomputer device 2. In the embodiment, the processor 1120 is used to runprogram code stored in the memory 1110 or process data.

The network interface 1130 may include a wireless network interface or awired network interface which is generally used to establish acommunication connection between the computer device 2 and othercomputer devices. For example, the network interface 1130 is used forconnecting the computer device 2 to an external terminal via a networkand establishing a data transmission channel and a communicationconnection between the computer device 2 and the external terminal. Thenetwork can be a wireless or wired network such as an enterpriseintranet, an Internet, a Global System of Mobile communication (GSM), aWideband Code Division Multiple Access (WCDMA), a 4G network, a 5Gnetwork, a Bluetooth, Wi-Fi, and so on.

The vibration element 1140 may include a vibration motor for providing avibration function.

It is to be noted that FIG. 11 shows only the computer device 2 havingcomponents 1110-1140, but it is understood that it is not required toimplement all of the shown components and that more or fewer parts canbe implemented in lieu thereof.

In the embodiment, a vibration control method for a computer devicestored in the memory 1110 may be divided into one or more programmodules and executed by one or more processors (processor 1120 in theembodiment) to complete the embodiment of the present application.

A Fourth Embodiment

The present application further provides a computer readable storagemedium, which stores computer programs, and when the computer programsare executed by a processor to realize the steps of a vibration controlmethod for computer device in the embodiment.

In the embodiment, the computer readable storage medium includes flashmemory, hard disk, multimedia card, card type memory (such as SD or DXmemory, etc.), random access memory (RAM), static random access memory(SRAM), read-only memory (ROM), electrically erasable programmableread-only memory (EEPROM), programmable read-only memory (PROM),magnetic memory, magnetic disk, optical disk and so on. In someembodiments, the computer-readable storage medium may be an internalstorage module of the computing device such as a hard disk or memory ofthe computing device. In other embodiments, the memory may also be anexternal storage device of the computing device, such as a plugged harddisk provided in the computer device, a smart media card (SMC), securedigital (SD) card, a flash memory card, and so on. Of course, thecomputer readable storage medium may also include both an internalstorage module and an external storage device of the computing device.In the embodiment, the computer-readable storage medium is generallyused to store an operating system and various types of applicationsoftware installed in the computing device such as program codes of thevibration control method for a computer device and the like. Inaddition, the memory may also be used to temporarily store various typesof data that have been or will be outputted.

It should be noted that in this application, “vibration” refers togenerating physical movement of tactile sensation.

Apparently, it should be appreciated by those skilled in the art thateach module or step described in the embodiment of the presentapplication can be realized by a general-purpose and that the modules orsteps may be integrated on a single computer device or distributed on anetwork consisting of a plurality of computing devices, optionally, themodules or steps may be realized by executable program codes so that themodules or steps can be stored in a storage device to be executed by acomputer device, and in some cases, the steps shown or described hereincan be executed in a sequence different from this presented herein, orthe modules or steps are formed into integrated circuit modules, orseveral of the modules or steps are formed into integrated circuitmodules. Therefore, the embodiment of the present application is notlimited to the combination of specific hardware and software.

The embodiments described above are just preferred embodiments of thepresent application and thus do not limit the patent scope of thepresent application. Any equivalent structure, or equivalent processtransformation made according to the contents of the description and thedrawings of the present application or any direct or indirectapplication to other related arts shall be also included in the patentprotection scope of the present application.

What is claimed is:
 1. A method for controlling vibrations of acomputing device, comprising: obtaining a target audio file of amultimedia file; dividing the target audio file into a plurality ofaudio segments; determining a target audio segment among the pluralityof audio segments based on detecting at least one feature associatedwith each of the plurality of audio segments, wherein the determining atarget audio segment among the plurality of audio segments based ondetecting at least one feature associated with each of the plurality ofaudio segments further comprises: determining an audio type of each ofthe plurality of audio segments, wherein the audio type comprises amusic audio type or a game audio type, and determining the target audiosegment based on a predetermined rule corresponding to the audio type;determining a target time period in a total time period of playing themultimedia file, the target time period corresponding to a playback ofthe target audio segment in the multimedia file; monitoring a currenttime point of playing the multimedia file; and controlling a vibrationelement in the computing device to perform a vibration operation whenthe current time point of playing the multimedia file is within thetarget time period.
 2. The method of claim 1, wherein the obtaining atarget audio file of the multimedia file further comprises: extractingan initial audio file of the multimedia file; determining a noise signaland a non-noise signal in the initial audio file based on content of themultimedia file; and separating the noise signal and the non-noisesignal in the initial audio file to obtain the target audio filecorresponding to the non-noise signal.
 3. The method of claim 1, whereinthe determining a target audio segment among the plurality of audiosegments based on detecting at least one feature associated with theeach of the plurality of audio segments further comprises: determiningwhether each of the plurality of audio segments comprises an abruptchange of the at least one feature.
 4. The method of claim 3, whereinthe determining whether each of the plurality of audio segmentscomprises an abrupt change of the at least one feature furthercomprises: determining whether a change of an energy exceeds a firstthreshold; determining whether a change of a pitch exceeds a secondthreshold; and determining whether a change of a timbre exceeds a thirdthreshold.
 5. The method of claim 1, wherein the determining a targetaudio segment among the plurality of audio segments based on detectingat least one feature associated with each of the plurality of audiosegments further comprises: obtaining at least one parameter indicatingthe at least one feature associated with each of the plurality of audiosegments; inputting the at least one parameter to a trained deep neuralnetwork model; and determining the target audio segment among theplurality of audio segments based on an output result of the deep neuralnetwork model.
 6. The method of claim 1, further comprising: detectingan audio power of each of the plurality of audio segments; andcontrolling the vibration element in the computing device to perform thevibration operation based on the audio power of each of the plurality ofaudio segments.
 7. A system, comprising: at least one processor; and atleast one memory communicatively coupled to the at least one processorand storing instructions that upon execution by the at least oneprocessor cause the system to perform operations comprising: obtaining atarget audio file of a multimedia file; dividing the target audio fileinto a plurality of audio segments; determining a target audio segmentamong the plurality of audio segments based on detecting at least onefeature associated with each of the plurality of audio segments, whereinthe determining a target audio segment among the plurality of audiosegments based on detecting at least one feature associated with each ofthe plurality of audio segments further comprises: determining an audiotype of each of the plurality of audio segments, wherein the audio typecomprises a music audio type or a game audio type, and determining thetarget audio segment based on a predetermined rule corresponding to theaudio type; determining a target time period in a total time period ofplaying the multimedia file, the target time period corresponding to aplayback of the target audio segment in the multimedia file; monitoringa current time point of playing the multimedia file; and controlling avibration element in the computing device to perform a vibrationoperation when the current time point of playing the multimedia file iswithin the target time period.
 8. The system of claim 7, wherein theobtaining a target audio file of the multimedia file further comprises:extracting an initial audio file of the multimedia file; determining anoise signal and a non-noise signal in the initial audio file based oncontent of the multimedia file; and separating the noise signal and thenon-noise signal in the initial audio file to obtain the target audiofile corresponding to the non-noise signal.
 9. The system of claim 7,wherein the determining a target audio segment among the plurality ofaudio segments based on detecting at least one feature associated withthe each of the plurality of audio segments further comprises:determining whether each of the plurality of audio segments comprises anabrupt change of the at least one feature.
 10. The system of claim 9,wherein the determining whether each of the plurality of audio segmentscomprises an abrupt change of the at least one feature furthercomprises: determining whether a change of an energy exceeds a firstthreshold; determining whether a change of a pitch exceeds a secondthreshold; and determining whether a change of a timbre exceeds a thirdthreshold.
 11. The system of claim 7, wherein the determining a targetaudio segment among the plurality of audio segments based on detectingat least one feature associated with each of the plurality of audiosegments further comprises: obtaining at least one parameter indicatingthe at least one feature associated with each of the plurality of audiosegments; inputting the at least one parameter to a trained deep neuralnetwork model; and determining the target audio segment among theplurality of audio segments based on an output result of the deep neuralnetwork model.
 12. The system of claim 7, the operations furthercomprising: detecting an audio power of each of the plurality of audiosegments; and controlling the vibration element in the computing deviceto perform the vibration operation based on the audio power of each ofthe plurality of audio segments.
 13. A non-transitory computer-readablestorage medium, storing computer-readable instructions that uponexecution by a processor cause the processor to implement operationscomprising: obtaining a target audio file of a multimedia file; dividingthe target audio file into a plurality of audio segments; determining atarget audio segment among the plurality of audio segments based ondetecting at least one feature associated with each of the plurality ofaudio segments, wherein the determining a target audio segment among theplurality of audio segments based on detecting at least one featureassociated with each of the plurality of audio segments furthercomprises: determining an audio type of each of the plurality of audiosegments, wherein the audio type comprises a music audio type or a gameaudio type, and determining the target audio segment based on apredetermined rule corresponding to the audio type; determining a targettime period in a total time period of playing the multimedia file, thetarget time period corresponding to a playback of the target audiosegment in the multimedia file; monitoring a current time point ofplaying the multimedia file; and controlling a vibration element in thecomputing device to perform a vibration operation when the current timepoint of playing the multimedia file is within the target time period.14. The non-transitory computer-readable storage medium of claim 13,wherein the determining a target audio segment among the plurality ofaudio segments based on detecting at least one feature associated withthe each of the plurality of audio segments further comprises:determining whether each of the plurality of audio segments comprises anabrupt change of the at least one feature.
 15. The non-transitorycomputer-readable storage medium of claim 13, wherein the determining atarget audio segment among the plurality of audio segments based ondetecting at least one feature associated with each of the plurality ofaudio segments further comprises: obtaining at least one parameterindicating the at least one feature associated with each of theplurality of audio segments; inputting the at least one parameter to atrained deep neural network model; and determining the target audiosegment among the plurality of audio segments based on an output resultof the deep neural network model.